Apparatus and method to maximize the display area of a mobile device

ABSTRACT

The technology disclosed here maximizes the size of the display area associated with the mobile device by various camera placement. In one embodiment, the camera is placed inside the mobile device, and can pop outside the mobile device when the camera is activated. When the camera is inactive the camera retracts inside the mobile device, and becomes unnoticeable to the user. In another embodiment, the camera is integrated into the mobile device display as a camera icon. The integrated camera serves two purposes: to record pictures, and to act as a camera icon, that when selected activates the camera. By removing the camera from the front side of the mobile device, or by integrating the camera into the display screen of the mobile device, the size of the mobile device display screen can be increased.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. Utility patent applicationSer. No. 15/165,887, filed May 26, 2016, which claims priority to the:U.S. Provisional Patent Application Ser. No. 62/249,130, filed Oct. 30,2015; U.S. Provisional Patent Application Ser. No. 62/300,631, filedFeb. 26, 2016; U.S. Provisional Patent Application Ser. No. 62/318,152,filed Apr. 4, 2016; all of which are incorporated herein by reference intheir entirety.

TECHNICAL FIELD

The present application is related to mobile devices, and morespecifically to methods and systems that maximize a display areaassociated with the mobile device by varying camera placement on themobile device.

BACKGROUND

Many mobile devices contain a front facing camera placed on the frontside of the mobile device, the same side occupied by the mobile devicedisplay screen. The mobile device screen does not occupy the full frontside of the mobile device because the top and bottom parts of the frontside are taken up by the camera and other devices. As a result, the sizeof the mobile device display screen is reduced.

SUMMARY

The technology disclosed here maximizes the size of the display areaassociated with the mobile device by various camera placements. In oneembodiment, the camera is placed inside the mobile device, and can beextended outside the mobile device when the camera is activated. Inembodiments of the invention the camera can be any of a front facingcamera, a back facing camera, a 360° camera, etc. When the camera isinactive the camera is retracted inside the mobile device, and isunnoticeable to the user. In another embodiment, the camera isintegrated into the mobile device display as a camera icon. Theintegrated camera serves two purposes: to record pictures, and to act asa camera icon, that, when selected, activates the camera.

In conventional designs, the mobile device screen does not occupy thefull front side of the mobile device because the top and bottom parts ofthe front side of the mobile device are taken up by the camera and otherdevices. By removing the camera from the front side of the mobiledevice, or by integrating the camera into the display screen of themobile device, the size of the display screen of the mobile device canbe increased.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an activate and an inactive camera associated with themobile device, according to one embodiment.

FIG. 2 shows an activated camera associated with the mobile deviceincluding a 360° lens, according to one embodiment.

FIGS. 3A-B show a front and a back view of an active camera comprising aplurality of apertures, according to one embodiment.

FIG. 4 shows a folded optical zoom lens associated with the camera,according to one embodiment.

FIG. 5 shows the camera port comprising additional accessoriesassociated with the mobile device, according to one embodiment.

FIG. 6 is a flowchart of a method to provide a camera, associated withthe mobile device 100, according to one embodiment.

FIG. 7A shows a front facing camera integrated into the display screenassociated with the mobile device, according to one embodiment.

FIG. 7B shows a front facing camera integrated into the display screenassociated with the mobile device, according to another embodiment.

FIGS. 7C-7E show borders between the camera 700, and the display screen710, according to various embodiments.

FIG. 8 shows a camera integrated into the display, according to oneembodiment.

FIG. 9 is a flowchart of a method to integrate a camera into the displayscreen, according to one embodiment.

FIG. 10 is a diagrammatic representation of a mobile device in theexample form of a computer system within which the above-describedapparatus may be implemented, and within which a set of instructions forcausing the machine to perform any one or more of the methodologies ormodules discussed herein may be executed.

DETAILED DESCRIPTION

The technology disclosed here maximizes the size of the display areaassociated with the mobile device by various camera placements. In oneembodiment, the camera is placed inside the mobile device, and can beextended outside the mobile device when the camera is activated. Inembodiments of the invention the camera can be any of a front facingcamera, a back facing camera, a 360° camera, etc. When the camera isinactive the camera is retracted inside the mobile device, and isunnoticeable to the user. In another embodiment, the camera isintegrated into the mobile device display as a camera icon. Theintegrated camera serves two purposes: to record pictures, and to act asa camera icon, that, when selected, activates the camera.

In conventional designs, the mobile device screen does not occupy thefull front side of the mobile device because the top and bottom parts ofthe front side of the mobile device are taken up by the camera and otherdevices. By removing the camera from the front side of the mobiledevice, or by integrating the camera into the display screen of themobile device, the size of the display screen of the mobile device canbe increased.

In various embodiments disclosed herein, the mobile device can have aplurality of cameras, where the plurality of cameras comprises one ormore camera embodiments disclosed here.

Camera

FIG. 1 shows an active and an inactive camera associated with the mobiledevice 100, according to one embodiment. The mobile device 100 includesan outer casing 140 associated with the mobile device, a camera port 110associated with the mobile device, and a camera 120 coupled to thecamera port. The outer casing 140 includes a plurality of surfaces, suchas the six sides of a traditional smart phone, such as an iPhone, or anAndroid phone. The camera port 110 can be aligned with one or more ofthe plurality of surfaces associated with the outer casing 140, i.e.,the camera can be placed anywhere on the mobile device, such as the topof the mobile device, the bottom of the mobile device, or any of themobile device sides. The camera comprises at least one aperture 130. Theaperture 130 can comprise various lenses ranging from an extremely longeffective focal length lens, an extremely short effective focal lengthlens, a normal lens, etc. The camera 120 is operable to, when the camerais inactive, retract inside the camera port 110, and align with eachsurface in the plurality of surfaces associated with outer casing 140,so that the camera 120 becomes unnoticeable when inactive. The camera120 is operable to, when the camera is active, protrude from the outercasing 140 associated with the mobile device, and position the aperture130 to receive light mostly unobstructed by the mobile device.

According to another embodiment, the mobile device 100 comprises a frontfacing camera 150, or a back facing camera 160, in addition to thecamera 120. There can be a plurality of front facing cameras such as thefront facing camera 150, plurality of back facing cameras such as theback facing camera 160, and/or a plurality of the extended cameras suchas the camera 120. The front facing camera 150 can be a cameraintegrated into the mobile device display, as described herein, or canbe a traditional front facing camera.

According to one embodiment, the camera 120 moves linearly inside thecamera port 110. The linear motion can be achieved using a linear guide,rack and pinion, a spring, etc. By placing the front facing camerainside the camera port, the display screen area can be increased toutilize the area traditionally associated with the camera in a mobiledevice 100 such as a smart phone, a tablet, a portable computer, etc.

According to another embodiment, the camera 120 can be a stand-alonecamera, attached to the mobile device as an accessory.

FIG. 2 shows an activated camera associated with the mobile device 100including a 360° lens, according to one embodiment. The lens cancomprise a top lens 200, and a bottom lens 210, and transparent casing220. The top lens 200 receives light beams beneath the plane 230. Thebottom lens 210 receives light beams above the plane 240. According toanother embodiment, the lens can comprise a single 360° lens. A lightguide, by totally, or nearly totally, internally reflecting the receivedlight, transmits the light received by the single 360° lens to the photosensors associated with the camera 120. The light guide can also includeadditional lenses to focus the light before the lights reaches the photosensors.

FIGS. 3A-B show a front and a back view of an active camera 120comprising a plurality of apertures, according to one embodiment. Thecamera 120 associated with the mobile device 100 includes a firstaperture 330, a second aperture 340, a plurality of photo sensors 310,and an optical element 300 coupled to the first aperture 330, the secondaperture 340, and the plurality of photo sensors 310. The first aperture330 and/or the second aperture 340 can be lenses having any focallength, from extremely short effective focal length, to extremely longeffective focal length. In one embodiment, the first and/or the secondlens can have up to 220° angle of view.

The optical element 300 is operable to change a direction of a lightbeam 320, 350 by changing the optical element's position. The change inthe direction of the light beam 320, 350 can be from 0° to 180°. Theoptical element 300 is operable to assume at least a first position, asshown in FIG. 3A, and a second position, as shown in FIG. 3B. The firstposition is operable to direct a light beam 320 associated with thefirst aperture 330 to the photo sensors 310 associated with the camera120, and the second position is operable to direct the light beam 350associated with the second aperture 340 to the photo sensors 310associated with the camera 120. The optical element 300 can be a mirroror a prism operable to reflect light, and/or refract light. The mirrorcan be made out of any reflective material, such as glass, reflectiveplastic, metal, etc. The prism can be a Porro prism, Amici roof prism,pentaprism, etc. The optical element 300 can be actuated by, or can be apart of a very small device, such as a micro-electromechanical systems(“MEMS”) device, a nano-electromechanical systems (“NEMS”) device, apico-electromechanical systems device, etc.

In addition to the first and second apertures 330, 340, as describedabove, the camera 120 can include a third aperture, a fourth aperture, afifth aperture, etc. Each aperture can correspond to a side of thecamera 120. In addition to the first and second position, as describedabove, the optical element 300 is operable to assume a third position, afourth position, a fifth position, etc., where each optical elementposition is configured to direct a light beam associated with anaperture to the photo sensors 310 associated with the camera. Any one ofthe optical element positions can direct the light by 0°, i.e., theoptical element 300 lets the light beam through to the photo sensors310.

According to one embodiment, the camera 120 can include a lens 370disposed between the plurality of photo sensors 310 and the opticalelement 300. The lens 370 can have an effective focal length between anextremely short effective focal length and an extremely long effectivefocal length. In another embodiment, the camera 120 can further includea light guide 360 connecting the apertures 330, 340, the lens 370, theoptical element 300, and the plurality of photo sensors 310, where thelight guide 360 is operable to transmit a beam of light 320, 350 betweenthe apertures 330, 340 and the lens 370. The light guide 360 can be madeof any material that totally, or nearly totally, internally reflectslight. As described above, the apertures 330, 340 can also be variouslenses.

According to another embodiment, the mobile device 100 can include asecond camera, where the second camera is displaced a short distancefrom the camera 120. In various embodiments, the short distance betweenthe two cameras roughly corresponds to the distance between a person'seyes, and in some cases mimics the distance between a person's eyes. Inother embodiments, the short distance between the two cameras is reducedto almost zero, to minimize the space that the two cameras occupy on themobile device 100. The second camera includes a second lens operable tocapture a second image. The second image corresponds to a first imagecaptured by the camera 120, where the second image and the first imagecomprise stereoscopic images. Stereoscopic images are two-dimensionalimages of the same scene, slightly offset, and corresponding to the leftand the right eye of a viewer. When the two images are viewed by aperson, the images give the impression of depth. Further, the capturedimages can include depth information associated with the scene. Thesecond camera can be a second extendable camera, can be a traditionalcell phone camera, can be a cell phone camera integrated into thedisplay, as described in this application, etc. The mobile device 100includes a processor coupled to the second camera and the camera 120.The processor is operable to extract depth information based on thefirst image and the second image, to correct aberrations in each image,to rectify images, to create stereoscopic images, and perform otherdepth related processes.

In other embodiments, additional cameras, such as a third, fourth,fifth, etc. camera, can be used to capture third, fourth, fifth, etc.image of the scene. The additional cameras can be extendable cameras,can be traditional cell phone cameras, can be cell phone camerasintegrated into the display as described herein, etc. The additionalcameras can be arranged in a regular pattern throughout the outer casingassociated with the mobile device.

FIG. 4 shows a folded optical zoom lens associated with the camera 120,according to one embodiment. The optical zoom lens 400 can be extendedwhen the camera 120 is active, or can be completely retracted to fitinside the camera port, when the camera 120 is inactive. Various lensesdisclosed in the current application can also include a folded opticalzoom lens.

According to another embodiment, the camera 120 can be an articulatedfiber optic camera, wherein the articulated fiber optic camera isoperable to be steered 360°. The lens associated with a fiber opticcamera can have an effective focal length from an extremely shorteffective focal length to an extremely long effective focal length.

In another embodiment, the various cameras disclosed herein furthercomprise a flash, such as a light emitting diode (“LED”) flash.

FIG. 5 shows the camera port 110 comprising additional accessories 500associated with the mobile device, according to one embodiment. Element510 is the camera 120 retracted into the camera port 110. The cameraport 110, in addition can include a subscriber identity module (“SIM”)card, or a memory card, such as Secure Digital (“SD”) card. By combiningadditional accessories 500 into the camera port 110, the number of portsassociated with the mobile device 100 are reduced, thus reducing thecost of manufacturing the mobile device 100, and reducing the risk offoreign substances, such as water or dust, contaminating the mobiledevice electronic circuitry.

In many of the embodiments disclosed here, the camera 120, 510 can beremovable whether the camera is active or inactive. The mobile device100 is operable to close off the camera port 110, so that the mobiledevice 100 appears as if the camera 120 is inactive.

The camera 120 disclosed here can be activated in a variety of ways suchas via a software associated with the mobile device, a dedicated buttonassociated with the mobile device, a voice activation, a gesture, or apower button associated with the mobile device. The gesture can be amotion associated with the whole mobile device, such as a quick motiondownwards, a shake of the mobile device, a tilting of the mobile device,etc. The gesture can also be associated with the display screen of themobile device, such as a swipe upwards, a selection of a camera icon,etc. The power button can be configured to serve a dual purpose, namely,to power off the phone, and to toggle the camera between active andinactive state. For example, the power button can turn the phone offwhen the power button receives long-press as input, and the power buttoncan toggle the states of the camera between active and inactive, whenthe power button receives a short-press as input.

FIG. 6 is a flowchart of a method to provide a camera 120, associatedwith the mobile device 100, according to one embodiment. In step 600, anouter casing 140 associated with the mobile device 100 is provided,where the outer casing includes a plurality of surfaces. In step 610, acamera port 110 associated with the mobile device 100 is provided. Instep 620, the camera 120 is coupled to the camera port 110. The camera120 comprises an aperture 130. When the camera 120 is inactive, thecamera 120 retracts inside the camera port 110, and aligns with eachsurface in the plurality of surfaces associated with the outer casing140. When the camera 120 is active, the camera 120 protrudes from theouter casing 140 associated with the mobile device 100, and positionsthe aperture 130 to receive light unobstructed by the mobile device 100.In various embodiments, additional method steps can be performed toenable the creation of the embodiments described above.

Camera Integrated into the Display

FIG. 7A shows a front facing camera 700 integrated into the displayscreen 710 associated with the mobile device 100, according to oneembodiment. The display screen 710 associated with the mobile device 100comprises a plurality of icons corresponding to: a plurality of mobiledevice software applications 720, and a plurality of mobile deviceoperating system functions 730. The camera 700, coupled to the mobiledevice 100, occupies a portion of the display screen 710. The displayscreen 710 can occupy the whole outer surface of the device 100, or canoccupy one whole side of the device 100, as shown in FIG. 7. The portionof the display screen occupied by the camera is operable to act as acamera icon in the plurality of icons, so that the camera 700 isactivated when the camera icon 700 is selected. The camera icon 700 canbe placed in a portion of the display screen 740 reserved for the mobiledevice operating system functions, or can be placed in a portion of thedisplay screen 750 associated with the mobile device softwareapplications. The camera icon 700 can be selected by touch, or can bevoice activated. When the camera icon 700 is selected, the camera icon700 can be operable to perform a variety of functions, such as launchinga camera application on the mobile device, taking a picture, etc. Byintegrating the camera 700 into the display, the area of the displayscreen is increased because the camera acts as both a camera operable torecord an image, and a camera icon operable to activate the camera.

According to another embodiment, the camera can be an articulated fiberoptic camera, wherein the articulated fiber optic camera is operable tobe steered in a plurality of directions. The outer casing associatedwith the mobile device can have a plurality of openings such as a frontfacing, back facing, left facing, right facing, or top facing opening.The fiber optic camera can be steered to receive light beams through anyof the plurality of openings associated with the outer casing. In oneembodiment, the fiber optic camera can be a front facing, a back facing,a left facing, a right facing, or a top facing camera. The lensassociated with a fiber optic camera can have a focal length from anextremely short effective focal length to an extremely long effectivefocal length.

FIG. 7B shows a front facing camera 700 integrated into the displayscreen 710 associated with the mobile device 100, according to anotherembodiment. In various embodiments disclosed herein, the mobile device100 can take on various shapes such as a cuboid shape, a cuboid shapewith rounded edges, an ellipsoid, a curved close surface, etc.Regardless of the shape, the mobile device 100 includes an outersurface. In various embodiments disclosed herein, the display screen 710occupies substantially the whole outer surface associated with themobile device 100. When the mobile device shape includes a plurality ofsides, such as when the mobile device 100 is shaped as a cuboid, or acuboid with rounded edges, and the display screen 710 is associated withone or more sides in the plurality of sides, the display screen 710occupies substantially all the sides with which of the display screen710 is associated.

In various embodiments disclosed herein, the camera 700 can be placedanywhere on the display screen 710, such as the upper right corner, thelower left corner, middle of the screen, middle of the upper edgeassociated with the display screen, etc.

In one embodiment, the border 705 between the camera 700 and the displayscreen 710 is perimeter associated with the camera 700. The camera 700and border 705 can take on various shapes such as a circle, a rectangle,a square, an ellipse, a curved shape, an open curved line, etc.

FIGS. 7C-7E show borders between the camera 700, and the display screen710, according to various embodiments. In various embodiments disclosedherein, the camera 700, the perimeter 705, 755, 765, 775 associated withthe camera 710, and the border 705, 760, 770, 780 between the camera 700and the display screen 710 can take on various shapes such as a circle,a rectangle, a square, an ellipse, a curved shape, an open curved line,etc. The shapes of the perimeter 755, 765, 775 and the border 760, 770,780 can have parallel lines, but do not necessarily have to haveparallel lines. FIGS. 7D-7E show an example where the perimeter 765, 775and the border 770, 780 do not have parallel lines. For example, FIG. 7Dshows the border 770 having a shape of an open curved line, while theperimeter 765 associated with the camera 700 has a rectangular shape.Similarly, FIG. 7E shows the border 780 having a square shape, while theperimeter 775 associate with the camera 700 has a circular shape. FIG.7C shows an example where the perimeter 755 and the border 760 do haveparallel lines.

Further, the border 760, 770, 780 between the camera 700 and the displayscreen 710 can enclose the perimeter 755, 765, 775 associated with thecamera 710 to various degrees. FIGS. 7C-7D show the border 760, 770partially enclosing the perimeter 755, 765. For example, in FIG. 7C theborder 760 encloses the perimeter 755 on three sides. In FIG. 7D, theborder 770 partially encloses the perimeter 765 on more than threesides, however the border 770 does not fully enclose the perimeter 765.FIG. 7E shows the border 780 fully enclosing the perimeter 775.

FIG. 8 shows a camera 700 integrated into the display, according to oneembodiment. The camera comprises a front aperture 800 occupying theportion of the display screen, a back aperture 810 disposed in adirection opposite of the front aperture 800, a plurality of photosensors 820, and an optical element 830 coupled to the front aperture800, the back aperture 810, and the plurality of photo sensors 820. Thefront aperture 800 and/or the back aperture 810 can comprise lenses thatcan have any effective focal length, from extremely short effectivefocal length, to extremely long effective focal length. In oneembodiment, the front and/or the back lens can have up to 220° angle ofview. In one embodiment, the front and/or the back lens can be a foldedoptical zoom lens, as depicted in FIG. 4.

The optical element 830 is operable to change a direction of a lightbeam 840 by changing the optical element's position. The change in thedirection of the light beam 840 can be from 0° to 180°. The opticalelement 830 can assume a first position, and a second position, wherethe first position is configured to direct a light beam associated withthe front aperture 800 to the photo sensors 820. The second position isconfigured to direct the light beam associated with the back aperture810 to the photo sensors associated with the camera.

The optical element 830 can be a mirror or a prism operable to reflectlight, and/or refract light. The mirror can be made out of anyreflective material, such as glass, reflective plastic, metal, etc. Theprism can be a Porro prism, Amici roof prism, pentaprism, etc. Theoptical element can be actuated by, or a part of a very small device,such as a micro-electromechanical systems (“MEMS”) device, anano-electromechanical systems (“NEMS”) device, a pico-electromechanicalsystems device, etc.

According to one embodiment, the camera can include a lens 860 disposedbetween the plurality of photo sensors 820 and the optical element 830.The lens 860 can have any effective focal length between an extremelyshort effective focal length and an extremely long effective focallength. In another embodiment, the camera can further include a lightguide 850 connecting the apertures 800, 810, the optical element 830,the lens 860, and the plurality of photo sensors 820, where the lightguide 850 is operable to transmit a beam of light 840 between theapertures 800, 810 and the lens 860. The light guide 850 can be made ofany material that totally, or nearly totally, internally reflects light.As described above, the apertures 800, 810 can also include variouslenses.

In various embodiments disclosed herein there can be a plurality offront facing cameras such as the camera 700. According to oneembodiment, the mobile device 100 can include a second camera, where thesecond camera is displaced a short distance from the camera 700. Invarious embodiments, the short distance between the two cameras roughlycorresponds to the distance between a person's eyes, and in some casesmimics the distance between a person's eyes. In other embodiments, theshort distance between the two cameras is reduced to almost zero, tominimize the space that the two cameras occupy on the mobile device 100.The second camera includes a second lens operable to capture a secondimage. The second image corresponds to a first image captured by thecamera 700, where the second image and the first image comprisestereoscopic images. Further, the first and the second image can includedepth information associated with the scene. The second camera can be asecond extendable camera as described herein, can be a traditional cellphone camera, can be a cell phone camera integrated into the display asdescribed herein, etc. The mobile device 100 includes a processorcoupled to the second camera and the camera 120. The processor isoperable to extract depth information based on the first image and thesecond image, to correct aberrations in each image, to rectify images,to create stereoscopic images, and perform other depth relatedprocesses.

In other embodiments, additional cameras, such as a third, fourth,fifth, etc. camera, can be used to capture third, fourth, fifth, etc.image of the scene. The additional cameras can be extendable cameras,can be traditional cell phone cameras, can be cell phone camerasintegrated into the display as described herein, etc. The additionalcameras can be arranged in a regular pattern throughout the outer casingassociated with the mobile device.

FIG. 9 is a flowchart of a method to integrate a camera into the displayscreen, according to one embodiment. In step 900, a display screenassociated with the mobile device 100 is provided, such that the displayscreen includes a plurality of icons. The plurality of icons correspondsto a plurality of mobile device software applications and a plurality ofmobile device operating system functions. In step 910, the camera isconfigured to record an image, and to appear to be a camera icon in theplurality of icons. The camera icon is configured to activate the camerawhen the camera icon is selected. The camera can be selected by touch,or can be voice activated. The camera can be a fiber optic camera. Invarious embodiments, additional method steps can be performed to enablethe creation of the embodiments described above.

Computer

FIG. 10 is a diagrammatic representation of a machine in the exampleform of a computer system 1000 within which a set of instructions, forcausing the machine to perform any one or more of the methodologies ormodules discussed herein, may be executed.

In the example of FIG. 10, the computer system 1000 includes aprocessor, memory, non-volatile memory, and an interface device. Variouscommon components (e.g., cache memory) are omitted for illustrativesimplicity. The computer system 1000 is intended to illustrate ahardware device on which any of the components described in the exampleof FIGS. 1-9 (and any other components described in this specification)can be implemented. The computer system 1000 can be of any applicableknown or convenient type. The components of the computer system 1000 canbe coupled together via a bus or through some other known or convenientdevice.

This disclosure contemplates the computer system 1000 taking anysuitable physical form. As example and not by way of limitation,computer system 1000 may be an embedded computer system, asystem-on-chip (SOC), a single-board computer system (SBC) (such as, forexample, a computer-on-module (COM) or system-on-module (SOM)), adesktop computer system, a laptop or notebook computer system, aninteractive kiosk, a mainframe, a mesh of computer systems, a mobiletelephone, a personal digital assistant (PDA), a server, or acombination of two or more of these. Where appropriate, computer system1000 may include one or more computer systems 1000; be unitary ordistributed; span multiple locations; span multiple machines; or residein a cloud, which may include one or more cloud components in one ormore networks. Where appropriate, one or more computer systems 1000 mayperform without substantial spatial or temporal limitation one or moresteps of one or more methods described or illustrated herein. As anexample and not by way of limitation, one or more computer systems 1000may perform in real time or in batch mode one or more steps of one ormore methods described or illustrated herein. One or more computersystems 1000 may perform at different times or at different locationsone or more steps of one or more methods described or illustratedherein, where appropriate.

The processor may be, for example, a conventional microprocessor such asan Intel Pentium microprocessor or Motorola PowerPC microprocessor. Oneof skill in the relevant art will recognize that the terms“machine-readable (storage) medium” or “computer-readable (storage)medium” include any type of device that is accessible by the processor.

The memory is coupled to the processor by, for example, a bus. Thememory can include, by way of example but not limitation, random accessmemory (RAM), such as dynamic RAM (DRAM) and static RAM (SRAM). Thememory can be local, remote, or distributed.

The bus also couples the processor to the non-volatile memory and driveunit. The non-volatile memory is often a magnetic floppy or hard disk, amagnetic-optical disk, an optical disk, a read-only memory (ROM), suchas a CD-ROM, EPROM, or EEPROM, a magnetic or optical card, or anotherform of storage for large amounts of data. Some of this data is oftenwritten, by a direct memory access process, into memory during executionof software in the computer system 1000. The non-volatile storage can belocal, remote, or distributed. The non-volatile memory is optionalbecause systems can be created with all applicable data available inmemory. A typical computer system will usually include at least aprocessor, memory, and a device (e.g., a bus) coupling the memory to theprocessor.

Software is typically stored in the non-volatile memory and/or the driveunit. Indeed, storing an entire large program in memory may not even bepossible. Nevertheless, it should be understood that for software torun, if necessary, it is moved to a computer readable locationappropriate for processing, and for illustrative purposes, that locationis referred to as the memory in this paper. Even when software is movedto the memory for execution, the processor will typically make use ofhardware registers to store values associated with the software, andlocal cache that, ideally, serves to speed up execution. As used herein,a software program is assumed to be stored at any known or convenientlocation (from non-volatile storage to hardware registers) when thesoftware program is referred to as “implemented in a computer-readablemedium.” A processor is considered to be “configured to execute aprogram” when at least one value associated with the program is storedin a register readable by the processor.

The bus also couples the processor to the network interface device. Theinterface can include one or more of a modem or network interface. Itwill be appreciated that a modem or network interface can be consideredto be part of the computer system 1000. The interface can include ananalog modem, ISDN modem, cable modem, token ring interface, satellitetransmission interface (e.g., “direct PC”), or other interfaces forcoupling a computer system to other computer systems. The interface caninclude one or more input and/or output devices. The I/O devices caninclude, by way of example but not limitation, a keyboard, a mouse orother pointing device, disk drives, printers, a scanner, and other inputand/or output devices, including a display device. The display devicecan include, by way of example but not limitation, a cathode ray tube(CRT), liquid crystal display (LCD), or some other applicable known orconvenient display device. For simplicity, it is assumed thatcontrollers of any devices not depicted in the example of FIG. 10 residein the interface.

In operation, the computer system 1000 can be controlled by operatingsystem software that includes a file management system, such as a diskoperating system. One example of operating system software withassociated file management system software is the family of operatingsystems known as Windows® from Microsoft Corporation of Redmond, Wash.,and their associated file management systems. Another example ofoperating system software with its associated file management systemsoftware is the Linux™ operating system and its associated filemanagement system. The file management system is typically stored in thenon-volatile memory and/or drive unit and causes the processor toexecute the various acts required by the operating system to input andoutput data and to store data in the memory, including storing files onthe non-volatile memory and/or drive unit.

Some portions of the detailed description may be presented in terms ofalgorithms and symbolic representations of operations on data bitswithin a computer memory. These algorithmic descriptions andrepresentations are the means used by those skilled in the dataprocessing arts to most effectively convey the substance of their workto others skilled in the art. An algorithm is here, and generally,conceived to be a self-consistent sequence of operations leading to adesired result. The operations are those requiring physicalmanipulations of physical quantities. Usually, though not necessarily,these quantities take the form of electrical or magnetic signals capableof being stored, transferred, combined, compared, and otherwisemanipulated. It has proven convenient at times, principally for reasonsof common usage, to refer to these signals as bits, values, elements,symbols, characters, terms, numbers, or the like.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. Unlessspecifically stated otherwise as apparent from the following discussion,it is appreciated that throughout the description, discussions utilizingterms such as “processing” or “computing” or “calculating” or“determining” or “displaying” or “generating” or the like, refer to theaction and processes of a computer system, or similar electroniccomputing device, that manipulates and transforms data represented asphysical (electronic) quantities within the computer system's registersand memories into other data similarly represented as physicalquantities within the computer system memories or registers or othersuch information storage, transmission or display devices.

The algorithms and displays presented herein are not inherently relatedto any particular computer or other apparatus. Various general purposesystems may be used with programs in accordance with the teachingsherein, or it may prove convenient to construct more specializedapparatus to perform the methods of some embodiments. The requiredstructure for a variety of these systems will appear from thedescription below. In addition, the techniques are not described withreference to any particular programming language, and variousembodiments may thus be implemented using a variety of programminglanguages.

In alternative embodiments, the machine operates as a standalone deviceor may be connected (e.g., networked) to other machines. In a networkeddeployment, the machine may operate in the capacity of a server or aclient machine in a client-server network environment, or as a peermachine in a peer-to-peer (or distributed) network environment.

The machine may be a server computer, a client computer, a personalcomputer (PC), a tablet PC, a laptop computer, a set-top box (STB), apersonal digital assistant (PDA), a cellular telephone, an iPhone, aBlackberry, a processor, a telephone, a web appliance, a network router,switch or bridge, or any machine capable of executing a set ofinstructions (sequential or otherwise) that specify actions to be takenby that machine.

While the machine-readable medium or machine-readable storage medium isshown in an exemplary embodiment to be a single medium, the term“machine-readable medium” and “machine-readable storage medium” shouldbe taken to include a single medium or multiple media (e.g., acentralized or distributed database, and/or associated caches andservers) that store the one or more sets of instructions. The term“machine-readable medium” and “machine-readable storage medium” shallalso be taken to include any medium that is capable of storing, encodingor carrying a set of instructions for execution by the machine and thatcause the machine to perform any one or more of the methodologies ormodules of the presently disclosed technique and innovation.

In general, the routines executed to implement the embodiments of thedisclosure, may be implemented as part of an operating system or aspecific application, component, program, object, module or sequence ofinstructions referred to as “computer programs.” The computer programstypically comprise one or more instructions set at various times invarious memory and storage devices in a computer, and that, when readand executed by one or more processing units or processors in acomputer, cause the computer to perform operations to execute elementsinvolving the various aspects of the disclosure.

Moreover, while embodiments have been described in the context of fullyfunctioning computers and computer systems, those skilled in the artwill appreciate that the various embodiments are capable of beingdistributed as a program product in a variety of forms, and that thedisclosure applies equally regardless of the particular type of machineor computer-readable media used to actually effect the distribution.

Further examples of machine-readable storage media, machine-readablemedia, or computer-readable (storage) media include but are not limitedto recordable type media such as volatile and non-volatile memorydevices, floppy and other removable disks, hard disk drives, opticaldisks (e.g., Compact Disk Read-Only Memory (CD ROMS), Digital VersatileDisks, (DVDs), etc.), among others, and transmission type media such asdigital and analog communication links.

In some circumstances, operation of a memory device, such as a change instate from a binary one to a binary zero or vice-versa, for example, maycomprise a transformation, such as a physical transformation. Withparticular types of memory devices, such a physical transformation maycomprise a physical transformation of an article to a different state orthing. For example, but without limitation, for some types of memorydevices, a change in state may involve an accumulation and storage ofcharge or a release of stored charge. Likewise, in other memory devices,a change of state may comprise a physical change or transformation inmagnetic orientation or a physical change or transformation in molecularstructure, such as from crystalline to amorphous or vice versa. Theforegoing is not intended to be an exhaustive list in which a change instate for a binary one to a binary zero or vice-versa in a memory devicemay comprise a transformation, such as a physical transformation.Rather, the foregoing is intended as illustrative examples.

A storage medium typically may be non-transitory or comprise anon-transitory device. In this context, a non-transitory storage mediummay include a device that is tangible, meaning that the device has aconcrete physical form, although the device may change its physicalstate. Thus, for example, non-transitory refers to a device remainingtangible despite this change in state.

Remarks

The language used in the specification has been principally selected forreadability and instructional purposes, and it may not have beenselected to delineate or circumscribe the inventive subject matter. Itis therefore intended that the scope of the invention be limited not bythis Detailed Description, but rather by any claims that issue on anapplication based hereon. Accordingly, the disclosure of variousembodiments is intended to be illustrative, but not limiting, of thescope of the embodiments, which is set forth in the following claims.

The invention claimed is:
 1. A mobile device, comprising: a displayassociated with the mobile device, the display comprising a displaysurface for displaying a plurality of icons; and a sensor disposedbeneath the display surface at a location coincident with at least oneof the plurality of icons, the at least one icon comprising a sensoricon, a physical component of the sensor underneath the display surfacevisible as at least a part of an appearance of the sensor icon, thedisplay surface at the location functioning as both a display for thesensor icon and an access point to the sensor, the sensor icon operableto activate the sensor when selected, and the sensor operable to performa sensing function when activated.
 2. The mobile device of claim 1, thesensor comprising a light sensor.
 3. The mobile device of claim 1,comprising: an outer casing associated with the mobile device, the outercasing comprising a plurality of surfaces; a sensor port associated withthe mobile device; and the sensor movably disposed inside the sensorport, the sensor comprising an aperture, the sensor operable, when thesensor is inactive, to retract inside the sensor port, and to align witheach surface in the plurality of surfaces associated with the outercasing, and the sensor operable, when the sensor is active, to protrudefrom the outer casing associated with the mobile device, and to positionthe aperture to receive light unobstructed by the mobile device.
 4. Themobile device of claim 1, comprising a border between the sensor and thedisplay, the border comprising a perimeter associated with the sensor.5. The mobile device of claim 1, comprising a border between the sensorand the display, the border comprising an outline partially enclosing aperimeter associated with the sensor.
 6. The mobile device of claim 1,the sensor icon disposed in a portion of the display reserved for aplurality of mobile device operating system functions.
 7. The mobiledevice of claim 1, the sensor icon operable to launch a sensorapplication on the mobile device when the sensor icon is selected. 8.The mobile device of claim 1, the sensor icon operable to take a picturewhen the sensor icon is selected.
 9. The mobile device of claim 1, thesensor icon disposed in a portion of the display associated with aplurality of mobile device software applications.
 10. The mobile deviceof claim 1, further comprising: a second sensor associated with themobile device, the second sensor displaced a short distance from thesensor, the second sensor operable to record a second imagecorresponding to a first image captured by the sensor; and a processorcoupled to the second sensor and the sensor, the processor operable tocreate stereoscopic images based on the first image and the secondimage.
 11. The mobile device of claim 1, the sensor comprising: a frontaperture occupying the location of the display coincident with thesensor icon; a back aperture disposed in a direction opposite of thefront aperture; a plurality of photo sensors; and an optical elementassociated with the front aperture, the back aperture, and the pluralityof photo sensors, the optical element changing a direction of a lightbeam, the optical element operable to assume a first position, and asecond position, the first position directing a light beam associatedwith the front aperture to the plurality of photo sensors associatedwith the sensor, and the second position directing a light beamassociated with the back aperture to the plurality of photo sensorsassociated with the sensor.
 12. The mobile device of claim 11, the frontaperture and the back aperture comprising a front lens and a back lens,respectively.
 13. The mobile device of claim 11, the sensor furthercomprising: a lens disposed between the plurality of photo sensors andthe optical element; and a light guide connecting the apertures, theoptical element, and the plurality of photo sensors, the light guidetransmitting a beam of light between the apertures and the lens.
 14. Themobile device of claim 11, the optical element comprising a mirror or aprism.
 15. A method, comprising: providing a display associated with amobile device, the display comprising a display surface for displaying aplurality of icons; and disposing a sensor beneath the display surfaceat a location coincident with at least one of the plurality of icons,the at least one icon comprising a sensor icon, a physical component ofthe sensor underneath the display surface visible as at least a part ofan appearance of the sensor icon, the display surface at the locationfunctioning as both a display for the sensor icon and an access point tothe sensor, the sensor icon operable to activate the sensor whenselected, and the sensor operable to perform a sensing function whenactivated.
 16. The method of claim 15, the sensor comprising a lightsensor.
 17. The method of claim 15, wherein the sensor icon is disposedin a portion of the display reserved for a plurality of mobile deviceoperating system functions.
 18. The method of claim 15, furthercomprising configuring the sensor icon to launch a sensor application onthe mobile device when the sensor icon is selected.
 19. The method ofclaim 15, wherein the sensor icon is disposed in a portion of thedisplay associated with a plurality of mobile device softwareapplications.
 20. The method of claim 15, comprising: providing an outercasing associated with the mobile device, the outer casing comprising aplurality of surfaces; providing a sensor port associated with themobile device; and disposing the sensor movably inside the sensor port,the sensor comprising an aperture, the sensor operable, when the sensoris inactive, to retract inside the sensor port, and to align with eachsurface in the plurality of surfaces associated with the outer casing,and the sensor operable, when the sensor is active, to protrude from theouter casing associated with the mobile device, and to position theaperture to receive light unobstructed by the mobile device.
 21. Amobile device, comprising: a display associated with the mobile device,the display comprising a display surface for displaying a plurality oficons; and a sensor disposed beneath the display surface at a locationcoincident with at least one of the plurality of icons, the at least oneicon comprising a sensor icon, a physical component of the sensorunderneath the display surface visible as at least a part of anappearance of the sensor icon, the sensor icon operable to activate thesensor when selected, and the sensor operable to perform a sensingfunction when activated.